"The highlighted tokens are primarily functional and grammatical elements in Japanese, such as auxiliary verbs, verb endings, and common particles, which are essential for expressing tense, aspect, modality, negation, and politeness. These tokens often appear at the end of clauses or sentences and are crucial for constructing natural, contextually appropriate Japanese sentences."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.59 | 1.0 | 0.18 | 0.305 | 0.18 | 1.0 | 0.0 | 0.82 |
fuzz | 0.75 | 1.0 | 0.5 | 0.667 | 0.5 | 1.0 | 0.0 | 0.5 |